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ABSTRACT 


In  Chapter  I  some  developments  in  testing  when  the  parameter, 
A  ,  is  a  random  variable  are  briefly  mentioned.  The  "compound 
decision  problem"  investigated  by  H.  Robbins  and  "An  empirical  Bayes 
approach"  considered  by  E.  Samuel  are  dealt  with  in  some  detail. 

Mention  is  made  of  works  by  J.  Hannan  and  G.  Meeden. 

In  Chapter  II  Meeden' s  results,  as  embodied  in  Chapter  III  of 
his  doctoral  thesis,  are  studied  in  detail.  Some  results  are  stated 
and  comments  are  made  on  his  main  theorems.  In  the  process  it  is 
possible  to  present  much  of  his  work,  more  concisely,  and  without  one 
main  theorem. 


In  Chapter  III  a  slightly  different  approach,  based  on  the 
concept  of  a  least  favourable  distribution,  is  taken  to  investigate 
the  same  problem.  This  results  in  a  characterization  of  the  least 
favourable  distribution.  Two  corollaries  are  then  proved.  The 
construction  of  the  UMP  Bayesian  test  when  A  is  N(0,1) , 


-00  <  9  < 


is  carried  out  and  its  power  is  compared  with  the  classical 


UMP  test  and  with  6 


6  =o 


For  the  case  when  A  is  binomial  the 


powers  of  the  classical  UMP  and  the  test  6^  for  the  size 


a  =  .05  are  compared. 


To  conclude  it  must  be  mentioned  that  a  much  more  concise 
version  of  Meeden' s  work  appeared  in  the  Annals  of  Mathematical 
Statistics,  June  1970,  when  the  present  thesis  was  ready  for  typing. 
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CHAPTER  I 


INTRODUCTION  AND  RECENT  DEVELOPMENTS 


1.1  An  Outline  of  Developments  in  Bavesian  Testing 

The  problem  of  Bayesian  testing  of  hypotheses  is  one  where 
the  parameter  under  test  is  assumed  to  be  a  random  variable.  The 
classical  theory  assumes  the  parameter  to  be  an  unknown  constant. 

For  some  time  one  school  ignored  the  possibility  of  the  parameter 
being  a  random  quantity.  Advances  were  made  in  the  classical  field, 
but  for  the  Bayesian  school  there  were  very  few  significant 
developments  until  1950. 

During  the  period  1915-1920  S.  Bernstein  and  R.  Von  Mises 
independently  proved  that  if  the  a  priori  density  of  a  random 
variable  0  is  continuous ,  then  as  the  number  of  independent 
observations  is  increased  the  a  posteriori  distribution  of  0  tends  to 
a  limit  distribution  which  is  independent  of  the  a  priori  density. 
However,  in  some  applications  the  number  of  observations  is  severely 
limited.  Recently  (1950-  )  some  developments  have  taken  place  in 

testing  when  the  parameter  is  a  random  variable. 

In  1950  H,  Robbins  considered  what  he  termed  the  compound 
decision  problem.  Essentially  he  considered  the  testing  of  a  simple 
hypothesis  against  a  simple  alternative;  A  -  -1  or  +1  and 
f  (x | X )  »  N (X , 1) ,  Considering  both  errors  equally  serious,  he  exhibited 
a  decision  rule  which,  compared  to  the  classical  MP  tests,  reduced 
the  overall  error  in  the  limit  (as  sample  size  °°) ,  This  rule  has 


2 


some  unfortunate  implications.  In  the  following  section,  his  paper 
of  1950  is  briefly  described. 

1. 2  The  Compound  Decision  Problem 

1.2.1  Statement  of  the  Compound  Decision  Problem 

Let  x  =  (x. , . . . ,x  )  be  a  random  vector  with  x.  (i=l,...,n) 
—  In  i 

independent  normal  random  variables  with  common  variance  1  and 
respective  means  w^ere  0^  *  +1  or  -1,  i  =  l,...,n  . 

On  the  basis  of  the  observed  x  we  are  to  decide  whether  0^=1  or 
-1,  i  »  l,,..,n,  in  such  a  way  as  to  minimize  the  expected  total 
number  of  errors. 


Let  ft  =  {0:0  =9  (  0  , . . . ,  0  )  ,  0  m  -1  or  1,  i=l 


I  •  •  •  / 


n 


M  •  •  f 


n} . 


Then  for  a  0_  e  ft  x  has  density: 


{2v) 


(1) 


1,2.2  Loss  Function  and  Decision  Rule  R 


Let  w (0  •  ,0)  .  -  (#i  9  0!  0.) 

—  n  i  x 


JL. 

2n 


n 


i*l 


l 


(2) 


be  an  arbitrary  ordering  of  ft  .  Then 


. 
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R,  a  decision  rule  (randomised)  specifies  a  probability  distribution, 
given  x,  i.e.  the  probability  that  Q_  =  0_^  ,  given  x  =  p(0_^  |x)  ; 
for  convenience  denote  this  probability  by  p_.  (x)  ,  then 

R  ;  Pj (x)  j  =  l,...,2n  Pj (x)  >_  0  and  £  p^ (x)  =  1  (3) 


if  l(r,6_) 
parameter  vector  is 
where 


is  the  expected  loss  in  using  R  where  the  true 

1  n 

6_  then  L(R,0_)  =  p  (0_)  -  —  £  Sgn  (0.)  /  <j)(x,0_)U.  (x)dx 

i=l 


p o )  =  2“  I  d+e .)  0  <  p(£)  £  1 

i=l 


(4) 


and 


“i'-  =  2 1  Pj'-1  (1+9{j)) 


(5) 


For,  expected  loss  given  0_  and  R  for  any  x  , 


„n 

2  n 


^  I  l  1  ?  -S± |  /  p(£(:l)  |x)4>  (x,£)dx 

j=l  i=l 


n  2 


n 


2^  1  Jl  J  P  (x)  |e|J)-9i|]<Mx,e)dx 


i=i  j=i 
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[2U  (x)  if  0  =  -  1 

Now  y  p . (x) I 9 f ^ -0 . I  =< 

j  3  11  \2  [  1-U .  (x)  ]  if  e  .  =  +  1 

1  —  1 


=1+0.  -  2  Sgn (6 . ) U . (x)  for  0.  =  +1 

l  l  l  —  i 


Hence 


1  n 

L(R,0)  =  p(0)  ’“I  Sgn  (0  .  )  J  (x  ,0  )  U .  (x)  dx 
—  —  n  .  ,  i  — •  —  i  —  — 


(6) 


i=l 


Thus,  in  general,  L(R,0_)  can  be  expressed  in  terms  of  tL  (x) 
i  “■  1 , . . ,  ,n  • 

1.2.3  Rule  R 
Let 


R  ;  0^  =  Sgn(x^) 


i  ^  1 , .  •  •  ,  n  . 


(7) 


Then  L(R,0)  =  0.1587  V0  e  ft 


For 


U.  (x) 
i 


is 


p{ 0 . =1 
i 


x} 


Indeed 


P*0*  "  ll*J 


I  P1  <*> 

{6:0. =1}  3 

1 


I  P-i<*> 


U+efj)> 


n 


u( (*)  . 


1+0  (j) 

i  ^ 

U.  (x)  is  also  the  expected  value,  given  x  ,  of  r- —  under  R  . 

Hence  IL  (x)  is  the  conditional  probability,  given  x  ,  of  6^-1, 

% 

So  for  R 


«i 
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tMx) 


if 

o 

A 

-H 

X 

if 

X.  <  0 
l 

L  (R/0 ) 


r 


n 


i 

i=l 


1+0  . 
1 


Sgn (0^) 


/  <Mx] 

x .  >0 

l 


which  after  integrating  with  respect  to  variables  other  than  x.  , 

l 

and  then  substituting  x^  -  0_^  =  y  becomes 


rv  1  n  1+0  sgn(0  )  +® 

L(R,0J  «  i  l  [-— - -  /  exp[-  ~y2]  dy] 

n  i-1  2  /ST  -0,  2 

1 


£  I  -  Sgn(6.)  [l-r(-9  )]] 

i=*l 


■  F(~l)  ■  — /  exp[-  ~  y2]dy 

/27  -» 


■  .1587  V8  e  Q  . 


1.2.4  A  Theorem  and  Decision  Rule  R 
Theorem  1.2.4. 1.  Let 

(i)  R  be  a  decision  rule  with  the  associated  functions  U.  (x) 
i  *  1, . . . ,n  as  in  (5)  . 

(ii)  ft  ■  {0:0eft,  p (0 )  *  — }  k  -  0,1,. ..,n  .  Thus  £  t  ft  iff 
exactly  k  components  of  £  are  1  . 

(iii)  h(£0  ^  0,  ?  0  be  defined  on  ft  such  that  h  (0_)  »  constant  = 

b^  on  ftj^  k  33  0 , . . .  ,n  . 

Then  for  a  given  h  (£)  ,  \  h(ejL(R,0.)  ■  min  for  the  (non-randomised) 

ft 


rule 


v- 


' 


6 


/ 


R  :  0  .  =  Sgn 


n-1 

l  bl  S! 

i  k  k 

1  ,  k=o 

x  .  -  —  In  — : — — - 

l  2  n-1 


(i) 


V 


J*  bk+lsk 

k=o 


(i) 


/ 


2  (x ,  +x .  + . . ,+x  .  )  ...  ... 

v  -  L  ~  31  32  ^  k  =  1 , . . .  ,  (n-1)  S(^}  =  S(l)  =  0, 

k  —  x  n 


where  =  £ 


(i) 


_  r>  ]f)[— 

S  '  '  =  1  Vi  and  )  is  taken  over  all  (  ,  )  combinations  of  the 

o  L  k 


integers  1,2, . . . ,i-l,i+l, . . . ,n  .  k  at  a  time. 


1  n 

Proof:  As  seen  in  (6),  L(R,9_)  =  p(0_)  ~  ~  l  Sgn(Q^)  /c|>  (x_,0_)  (x)  dx 


i=l 


n 


I  h  (0_)  L  (R,  0_)  =  l  h(£)p(0.)  -  i  J  III  h(0_)  Sgn  (0  . )  cf>]  U .  (x)  dx 
ft  "  ft  i-l  ft  1  1 


This  will  be  min  iff 


1  if  l  h(0_)  Sgn (0  .  ) cj>  (x,0J  >  0 

a  1 


U.(x) 


0  otherwise 


(9) 


Let 


ft,  .  =  {0  :0eft,  ,  0 . =1} 

k,i - k  l 


ft,  .  =  {0:8eftv,  0,=-l} 

K  / X  K  X 


(10) 


Thus  ft,  =  ft,  ,  +  ft,  .  ,  where  +  :  Union.  Then,  from  (9) ,  U. (x)  =  1 
k  k,i  k,i  i 

if 
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n 


l  bv  [  l  <t>  (x ,  e_)  -  l  $  (x ,  e_)  ]  >  o 

a” 


k=°  < 

k,i 


k,i 


But  <j>(x,0)  =  -  exp[- 


(  2tt  ) 


n/2 


1  9  T1 

—  (%+n)]  exp[£*x  ]  ,  see 


(1)  Hence 


Ui(x)  =1  if 


n  Q  T  Q  T 

I  b  r  J  ei'i  -  J  >  0 


k"°  + 

k,i 


fi 


k,i 


1  •  x 

or  multiplying  throughout  by  e -  ,  where  1^  *  (1, we  have: 


l  b.  [  l  -  I  e(i+5-),xT]  >  0 


k550  + 

k,i 


k,i 


Now  for  fl  ,  0  «  1  and  hence 

K  f  X  1 


I 


2  2  (x ,  +X  +...+X.  ) 

(1+0.)  *x*  _  £  e  i  e  J1  32  Jk-1 


e  —  —  —  * 


fi 


k/i 


0 


k#i 


where  j  ,  r  *  l,...,(k-l),  belong  to  {1,2, . , . ,i-l,i+X, . . . ,n}  . 


Hence 


Q 


l 

+ 

k,i 


(1+0) *x 


2x 


e 


ls}x) 

k-1 
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Similarly  for  ft  .  ,  0 .  =  -1  and  hence 

f  —  JL 


r  (1+0) -xT 

L  e - - 


l 


2  (x  .  +x .  +. . ,+x .  ) 
“  '  3k 


3i  i2 


k,i 


or  (x)  =1  if 


l  >  0 

k=o 


or 


x.  >  4  In  , 
i  2  n-1 


n-1 

l  V* 

k=o 


(i) 


(ID 


J*  bk+lSk 

k=o 


(i) 


Hence  £  h(0_)L(R,0_)  =  min  for  the  rule 

fl 


R 


0^  -  Sgn 


/  n-1 

l  \S 

1  * 


(i) 

k 


Xi’  2ln^l 


L  k+1  k 


(i) 


/ 


(12) 


Definition:  A  decision  rule  R  is  called  symmetric  if  L(R,0_)  = 
constant  *  c.  for  0  e  ft,  k  *  0,1,..., n  . 
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Corollary:  1.2. 4.1.  If  =  1  Vk  =  0 , 1 , . . . ,n  . 


R  =  R  :  0  =  Sgn(xi) 


r»  ^ 

and  l  L(R,0_)  =  min  when  R  =  R  .  Then  for  any  R  with  associated 

n 

functions  IT  (sc) 


l  L(R,0_)  >  l  L(R,0_)  =  2nF(-l) 

fi  0, 


'V 

Hence  max  L(R,0_)  >  max  L(R,0_)  =  F(-l)  . 

0eft  0efi 


n  —  1 

Corollary:  1.2. 4. 2.  If  b  =  (  )  then  by  (12)  we  have  that 

iC  .K 

n  1 
n  H  1  r* 

l  (  )  2,  L(R,0_)  =  min  in  the  class  of  all  R  ,  for  the  symmetric 

k=o  k  fl_ 
k 

rule 


To  prove  that 


we  prove  that 


Proof :  Let  0 


R  :  0  . 
1 


=  Sgn 


n-l  .  , 

I  0  4 


11  \ 


1  n  k=o 
x.-  —  In  — — 
l  2  n-l 


\ 


y  (  n  rV1* 

L  K+l'  * 


k=o 


R  :  0 .  =  Sgn 

l 


n-l  t  / •  \ 

i  0  4 

1  ,  k=o 

x.-  —  In  — - - 

l  2  n-l 


/ 


\ 


k=o 


n  v -1„ (i) 
k 


I 


e  ,  k  =  0,1,2/ ...  ,n  L(R,8_)  =  c} 


e  £2,  and  let 
k 


(13) 


is  symmetric. 


1 


10 


1 

2 


In 


n-1 

I 


k=o 


(i) 

k 


n-1 

l 

k=o 


(  n  )  1s (i) 

k+1  k 


L(i) 


L(R,£) 


_1_ 

2n 


2 

l 

j=l 


x)  <j>  (x_,  6_)  dx_ 


_1_ 

2n 


l 


s=o 


n 

l  l 


n  i=i 
s 


© ^  )  i  |  /  |x)<j>dx 


Suppose  0_(j)  z 
for  r  =  1,2 , . . .  ,s 
x 


where  s  z  {0,1,2,. 
and  0 =  -1  for 

Dv. 


.  ,n> 
r  = 


;  suppose 
s  +  1 , .  . . 


0(j) 

jr 
,n  . 


p(0(j)  |x) 


=  1 


=  0 


if  x .  -  L (3  )  >  0 

3  r 

and  x .  -  L  ( j  )  <  0 

1  r 

Jr 

otherwise . 


r  =  1 , . , .  ,s 

r  =  s+1, , , , , 


Thus 


/  |x).$dx 


=  J  <J)dx 

S 


where 


S 


{3c:x.  )  >  0  r  =  1,2 

■^r 

x.  -L ( j  )  <  0  r  =  s+1 
3  Jr 
Jr 


,s  and 

,n}  . 


This  is  the  same  V0  z  ft, 

—  k 


and  V0  z  ft 
—  s 


Let  this  be  p(s, 


(13a) 

=  1 

Then  given 


k) ;  then 


by  (13a) 


11 


2n 


2n 


n 

I 

n 

1 1  l 

s=o 

0eft  i=l 
—  s 

n 

n 

I 

p(s,k)  l 

s=o 

i= 

n 

n 

l 

P  (s  ,k)  l 

3=0 

i= 

n 

I 

s=o 

p(s,k)  [k  ( 

(j) 


which  depends  only  on  k  and  hence  V0_  e  ft  ,  L(R,0_)  =  c  , 

'  K  X. 

k  —  0,1, ...,n  .  LJ 


Also  note  that  if 

R  is  any  symmetric 

rule  with 

L(R,0_) 

=  e,  ,  and  if  0  e  ft. 

n  n 

then  l  c  =  l 

O"1  l  MR.ej 

K  K 

k=o  k=o 

there 

are  (£)  points  in  ft 

,  ,  As  a  result  if 

k 

MM)  =  ck  , 

then 


as 

0  e  ft, 
—  k 


l 


k=o 


l 


k=o 


(n+l)F(-l) 


and 


1 

n+1 


l 

k=o 


<  F(-l)  . 


1.2.5  The  Rule  R* 


Let 


+oo 

if 

x  <  -1 

1 

1-x 

if 

TT  in 

-1  <  X 

2 

—  00 

1+x 

if 

X  >  1 

(14) 
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and  let 


-ft 

R  :  0  =  Sgn(xi~x  )  i  =  l,...,n  . 


(15) 


Then 


L (R*  ,0_)  =  h[p (_0)  ,n] 


(16) 


and 


lim  {L  (R*  ,0.)  -h  (p  (0_) )  ]  *  0  uniformly  V0_  e  ft  (17) 

n~*» 


where 


h(p,n)  ■  pF (-2p/n)  +  (l-p)F [-2 (1-p) /n] 


+  / 


2p/ n 

-2  ( l^p)  /n 


{pF[£~  (-1-  ~  +  -  L  (p)  )  3 
n"*  j.  y™  4 


+  (l-p)F[/~  (-!„  JL  .  i  L(p))]}f(x)dx 
n-1  /J  2 


(IS) 


l-p+ 


where  f (x)  =  N (0,1) ,  L(p)  =  -  In 


2/n 


P“ 


x 


and 


2/n 


h(p)  «  pF(-l+  In  +  (l-p)F(*"l-  ~  In  —^■) 

*  P  *  P 


(19) 
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.  *  't 

Robbins  compares  the  risks  for  R  and  R  for  n  =  100. 
The  table  is  as  follows: 


TABLE  I 


p 

L(R,0) 

L(R*,6_) 

h  (p) 

0 

or 

1 

.1587 

.0041 

0 

.1 

or 

.9 

.1587 

.0763 

.0691 

.2 

or 

.8 

.1587 

.1174 

.1121 

.3 

or 

.7 

.1587 

.1439 

.1387 

.4 

or 

.6 

.1587 

.1591 

.1538 

.5 

.1587 

.1628 

.1587 

Here 


P 


-  (#  of 


0.30. 

l  l 


1) 


Hence  if  p  -  .5  then,  considering  the  expected  number  of 
errors,  it  is  better  to  use  R  ;  however  if  p  /  .5  ,  then  by  using  R 
one  would  be  balancing  the  possibility  of  a  slightly  higher  risk  near 
p  ^  .5  against  a  much  lower  risk  near  p  =  0  or  1  . 

•ff 

In  conclusion  R  is  not  shown  here  to  be  a  best  rule  in 

% 

any  sense,  but  it  is  as  simple  as  R  and  in  certain  circumstances 
(p^.5)  it  would  seem  better  than  R  . 

1.2.6  Implications  of  Procedure  R 

* 

The  use  of  R  to  test  0^  =  +1  or  -1  i  =  l,...,n 
implies  that  the  decision,  say,  to  accept  or  reject  each  of  n  products 
(one  of  which  may  be  a  pair  of  shoes ,  another  a  shirt  and  yet  another 
the  height  of  an  individual)  depends  on  all  the  products.  And  this 


■ 
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aspect  is  unsatisfactory  say  to  the  manufacturer  of  shoes.  However 
it  is  argued  that  if  R*  reduces  the  cost  of  sampling,  and  this 
reduction  is  passed  on  to  the  consumer  it  may  be  welcome  to  him. 

1.2.7  Asymtotic  Solutions  of  the  Compound  Decision  Problem 

In  1955  J.  Hannan  and  H.  Robbins  considered  the  same  problem 
when  f(x|X)  was  any  completely  specified  distribution,  X  =  0  or  1. 
They  took  the  risk  to  be  the  weighted  probability  of  wrong  decisions, 
and,  for  n  sufficiently  large,  they  found  decision  functions  whose 
risks  are  uniformly  close  to  the  envelope  risk  function  of  "invariant" 
decision  functions. 

In  1963  E.  Samuel  proved,  for  testing  a  composite  hypothesis 
against  a  composite  alternative,  the  convergence  of  the  risk  function 
of  empirical  Bayes  rules  to  the  Bayes  envelope  risk  function  for 
geometric,  Poisson  and  negative  binomial  distributions.  Then  Samuel 
also  considered  tests  where  x  was  a  continuous  random  variable  with 
f(x|X)  of  the  exponential  family.  The  results  on  discrete  distributions 
are  summarized  in  the  following  section. 

1. 3  The  Empirical  Bayes  Approach 

1.3.1  Statement  of  the  Problem  and  Notation 

We  consider  a  situation  where  {(X.,A.)}?  is  a  sequence 

l  l  i=l 

of  independent  pairs  of  random  variables  such  that  the  AVs  are 

identically  distributed  with  common  distribution  function  G  and  where 

for  i  =  1 , . . . ,n  P  {X . <x I  X }  =  P[x|X].  Further  the  pairs  (X.,A.) 

i —  11  ii 
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arise  sequentially  and  after  each  occurrence  the  statistician  has  to 
take  a  decision  about  A  ,  which  is  not  observable. 

We  are  concerned  with  testing 

H  :  A  <  X  against  H.  :  A  >  A  (19) 

o  —  o  1  o 

H  :  A  >  A  against  H,  :  A  <  A  (20) 

o  —  o  1  o 

H  :  I A-A  I  <  A  against  H.  :  I  A— A  I  >  A  (21) 

o  o  —  1  o 

H  :  I A-A  |  >  A  against  H.  :  I A-A  I  <  A  (22) 

o  o  —  1  o 

Furthermore  we  deal  with  the  Poisson,  geometric  and  negative 
binomial  distributions  where  the  probability  density,  given  A,  is  as 
follows : 


P(x|A)  =  AXh(A)g(x)  x  =  0,1,2,... 


(23) 


where  for: 


Poisson 

geometric 

negative 

binomial 


h  (A )  =  e  A,  g(x)  =  —  A  >  0 
h  (A )  =  ,  g  (x)  =  1  (0<A<  1) 

h (A )  =  (l-A)-m,  g (x)  =  (X+m  1) ,  m  a  positive 

X 

integer  0  <  A  <  1. 


Since  in 


(19) -(22)  we  have  two-action  problems  let 
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Ai  :  Hi  correct  i  =  0,1  .  (24) 

and  the  loss  incurred  in  taking  action  A_^ ,  when  X  is  the  true 
parameter  value ,  be 

Li  =  L[Ai'X]  i  =  0,1  .  (25) 

Then  a  decision  function  t(x)  is  such  that  when  X  =  x  is  observed 

we  decide  with  probability  t  (x_)  that  A^  is  true  and  with 

probability  1  -  t(x)  that  A  is  true. 

—  o 

Definition: 


R(t/G)  =  /  /  { t (x) L. + (1-t (x) ) L  }fdydG 

« as  ° 

=  E  [L  ]  -  E{  t  (x)  E  [L  -L  |  x]  }  (26) 

GO  G  O  1 

where  f(x|X)  is  the  conditional  density  of  x  given  X  with  respect 
to  some  measure  p  ,  E  denotes  expectation  with  respect  to  the 
distribution  of  (X,A),  E^  to  that  of  A  and  E_[  |x]  conditional 
expectation  given  x. 

To  prove  (26)  we  have 

R(t,G)  «  /  /  {t(x)L  +(l-t(x) )L  }£(x|X)dydG 

ft  se  1  ° 

-II  L  f (x | X ) dydG  -  /  /  t (x) [L  -L  ] f (x | X ) dydG 

ft  °  u  x  ° 

-  E  rL  ]  -  /  t(x)  [/  [L  -L.  |  x]  f  (X  |  x)  dvdG 

G  °  SG  fi  °  1 


‘ 
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where  f(A|x)  is  the  conditional  density  with  respect  to  some 
measure  v  . 


(t,G)  =  E  [L  ]  -  /  t  (x)  E  [L  -L  I  x]  f  (x) 
G  O  G  O  1 


dx 


=  E  [L  ]  -  E{ E  [L  -L. | x ] } .  □ 
Go  G  o  1 


For  a  given  G,  there  usually  exists  a  decision  rule  <J)  such 

G 


that 


R(4>Q)  =  mjn  R(4>  ,G)  . 


From  (26)  for  a  rule  $ 


R  (<t>,G)  =  E  [L  ]  -  E{  t  (x)  E  [L  -L.x]} 
GO  G  O  1 


and  cj) ' s  which  minimize  R  ( , G)  over  rules  <}>  are  of  the  form 


(x)  =  1 

if 

eg[Vli 

|x] 

>  0 

=  0 

if 

WLil 

|  X] 

<  0 

(27) 

=  arb [0,1] 

if 

E_(L  -L  | 
G  O  1 

1  X] 

=  0  . 

Definition:  The  min  R(<j>,G)  is  called  the  Bayes'  envelope  function. 

J 

Denote  this  by  R(G) . 

Let  be  a  random  vector  independent  of  vector  (X,A) , 

k  (x,X  )  a  function  of  (x,X  )  and  k(x)  and  of  x  only.  Define 
n  — n  — n 


■ 
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X  )  =  1 
— n 

if 

k  (x ;  X  )  >  0 
n  — n 

(28) 

=  0 

if 

k  (x; X  )  <0 

n  — n  — 

i — 1 

ii 

M 

if 

k  (x)  >  0 

(29) 

=  0 

if 

k  (x)  <_  0 

1 

if  k (x)  > 

0 

0 

if  k (x)  < 

0 

(30) 

arbitrary 

[0 

,1]  if  k (x)  = 

0  . 

Suppose  k(x)  is  such  that 

R(tk,G)  =  R(tk/G)  Vtk  (31) 

This  is  satisfied  if  k(x)  =  E^CL^-L^Jx]  , 

1.3.3  A  Theorem 

Theorem;  If  (i)  k  (x,X  )  -*■  k(x)  in  probability 

n  — n 

(ii)  Ej|L  -L-l  1  <co 

G  O  1 
k  k 

Then  lim  R(t  ,G)  ■  R(t  ,G) 

n 

n-H» 

=  R(G)  if  k (n)  =  E_[L  -L  |x] 

o  O  1 

=  Bayes  envelope  risk. 

Proof;  We  use; 

E  to  denote  expectation  with  respect  to  the  distribution  of  (X,A) ,X 

— n 

Ea  to  denote  expectation  with  respect  to  the  distribution  of  (X,A) 

E^  to  denote  expectation  with  respect  to  the  distribution  of 
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E  to  denote  expectation  with  respect  to  the  distribution  of  A 
G 

E  [lx]  the  conditional  expectation  given  X  . 

G 


We  have  to  show  that: 


lim  E{tNx,X  J  *E  [L  -L-  |x]  }  =  E^{  tk  (X)  E  [L  -L  |  x]  } 
n  — n  G  o  l  *  G  o  1 ' 

n-*» 


Now  E{tk(X,X  )  E  [L  -L.  lx]}  =  E*{E  [tk(X,X  )|x]*E„[L  -L  J  x] 
n  — n  G  o  1'  *  n  n  — n  1  G  o  l1 


k  k  k 

lim  E  {t  (x,X  )  }  -*•  t  (x)  by  definition  of  t  (x,X  )  in  (28) 
.  n  n  — n  n  — n 

n-*» 


and  be  hypothesis  (i) . 


k  i  k  i 

lim  E  [t  (x  ,X  )  ]  E  [L  -L  x]  -►  t  (x)E^[L  -L.  x]  . 
n  n  — n  G  o  1 1  G  o  1 

n-*» 


i  k  ii  i  ii  i  k  i 

Also  E  [t  (X,X  )]E„[L  -lJx]  <  E  f  L  -L,  x]  as  t  <  1  .  Hence 
1  n  n  -n  G  o  l1  1  —  G  1  o  1M  1  n1  — 

using  hypothesis  (ii)  and  the  Lebesgue  dominated  convergence  theorem 


lim  E  { E  [tk(X,X  ) E  [L  -L. lx]}  =  E  { tk (X) E  [L  -L  | x] } 
*  n  n  — n  G  o  1 1  *  G  o  1 1 

n-*°° 


i.e.  lim  E{tk(XfX  )E„[L  -L. I x] }  =  E . { tk (X) E  [L  -L. lx]}.  □ 

n  — n  G  o  i  *  G  o  1 

n-x» 


1.3.4  Application  to  the  Poisson,  Geometric  and  Negative  Binomial 
Distributions 

To  test  (19)  let 


L  —  c  (X— X  )  A  >  X 


o  o 

=  0 


< 

—  o 
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L,  =  c  (X  -X)  X  <  X 
1  o  o 


=  0 


>  X 

—  o 


where  c  >  0.  Then  in  case  of  the  geometric  and  negative  binomial 

0  <  X  <  1  and.  whatever  G,  we  have  E  [  I  L  -L.  j]  <  00 .  For  the  Poisson 
—  —  G  o  1 

case,  we  assume  that  E  [|x|]  <  00 .  Hence,  for  all  three  distributions, 

G 

(ii)  is  satisfied. 


Now  define 


p  (x)  =  p(x,X  )  x  =  0,1,2,. . 
n  n  — n 


=  —  { #  of  indices  i  such  that  X.  =  x  i=l,...,n} 
n  l 


Then,  by  the  strong  law  of  large  numbers. 


lim  P  (x)  =  P_ (x) 
n  G 

n->°° 


(32) 


the  marginal  density  of  X  whatever  G.  Now 


c  f  (X-X  ) P (x I  X ) dG (X ) 


eg[VliIx]  = 


a 


/n  P (x | X ) dG (X ) 


(33) 


By  (23)  PQ(x) 


g(x)  /  XXh(X)dG(X)  .  Hence 

n 


r  I  ,  g(x)  PG(X+1) 

EG[Lo"Lllx]  C  g(x+l)  Pr(x) 


-  cX 


(34) 
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P  (x+1) 

Letting  k  (x,X  )  =  c  ^  ^ - ^  - cA  by  (32) 

n  —  n  g(x+l)  P  (x)  o 

n 

(X)  PG(x+l) 

k  (x,X  )  -►  c  —7 — 7-7—  — — 7—7 —  in  probability.  Hence  if  we  take  x 

n  — n  g(x+l)  P  (x)  *  2 


-  x 


n+1' 


the  theorem  applies  and  if  t  n  (x  ,  )  =  1  k  (x  , )  >  0 

n+1  —n  +  1  n  —n+1 


=  0 


otherwise . 


Then  lim  R(t  ,G)  =  R(G) .  Now 
n 

n-*°° 


g(x)  =  xl 


for  Poisson 


=  1 


for  geometric 


(35) 


,x+m-lv  .  .  .  ,  .  .  , 

=  (  )  m  >  0  negative  binomial. 


Hence  the  rules  are  t  , (x  , )  =  1  if 

n+1  —n+1 


(Vl+1)VXn+l+1) 

>  A  P  (x  ) 

0  n  n+1 

Poisson 

VW1’ 

>  A  P  (x  _) 

0  n  n+1 

geometric 

(36) 

(W1)Pn(Xn+l+1) 

>  A  (x  +m)  P  (x  ) 

0  n+1  n  n+1 

negative  binomial 

Similarly,  rules  for  testing  other  hypotheses,  (20)-(22), 


can  be  written  down.  For  (21)  i.e.  H  :  A-A  <  A  against 

o  1  o  — 

H,  :  I A-A  |  >  A  .  Let 


L  (A  ,A ) 

=  0 

if 

I  A-A 

< 

A 

0 

1  0 1 

=  c [ (A-A  )2-A2] 

if 

I  A-A  I 

> 

A 

0 

1  0 1 

L(AX,A) 

=  0 

if 

0 

> 

A 

=  c  [A2-  (A-A  )2] 

0 

if 

0 

1 

r< 

< 

A 

(37) 
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For  the  Poisson  case  we  assume 


E  [A2]  <  ». 


Then 


VLo-Liix]  - 


cg(x)  /  [A2-2A  A+(A2-A2)  ]AXh(A)dG(A) 
fl  °° _ 

g(x)  /  h(A)AXdG(A) 

n 


=  c  { 


g(x) 

g  (x+2) 


PQ (x+2) 


-  2A 


.  P  (x+1) 
g  (x)  G 


o  g (x+1)  P  (x) 


■} 


+  c  ( A  2— A  2 ) 
o 


(38) 


using  (23).  Hence  by  (32)  k  (x,x  )  ■+■  E_[L  -L,  x]  where 

n  - n  g  o  1 


k  (x,x  ) 
n  — n 


c  { 


g(x) 

g(x+2) 


P  (x+2) 
n _ 

Pn(x) 


_  /  v \  P  (x+1) 

* ^  g  ( x )  n  i  ,,  2  A  2V 

2A  — ■ — 777 - - — 7— r — t  +  c(A  -A  ) 

o  g(x+l)  P  (x)  o 


(39) 


n 


Finally  taking  x  =  xn+i  we  have  ^+1^+1^  “  1  if'  the  followin9 
holds  and  0  otherwise: 


,  Pn(Xn+l+2)  . Pn(xn+1+1)  .2  ,2  _  , 

(Vl+2)  ~~x~"  ~)  2Xo(xn+l  11  "p  (x  'I'  ?  a  -  Xo  Poisson 


n  n+l‘ 


n  n+1 


Pn (Xn+l+2>  „  Wl+1>  .  A2  _  ,2 

P  (x  ,  _ )  o  P_  (x_  , , )  o 


n  n+1' 


n  n+1 


Geometric 


(W2)2  VXn+l+2)  _  (Vl+1)  VW11  ,.2,2 

(x  ,+m+l)  P  (x  , )  (x  _+m)  P  (x  . )  o 


n+1  2  n  n+1' 


n+1  n  n+1' 


Negative 
Binomial . 
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1. 4  An  Outline  of  Meeden's  Results 

There  have  been  others  who  considered  the  problem  of  finding 
optimum  Bayesian  tests.  One  that  concerns  us  is  Glen  Meeden's. 
Essentially,  in  his  main  theorems,  he  investigates  the  problem  of 
existence  of  UMP  Bayesian  tests  with  a  priori  distribution  partially 
known.  The  parameter  0  of  the  a  priori  density  is  assumed  unknown 
but  in  a  set  0  . 

He  seeks  a  test  which,  subject  to  bounding  the  more  serious 
error,  minimizes  the  other  error  among  a  class  of  decision  functions. 
Initially  he  establishes  some  relations  between  the  Bayesian  and 
classical  tests.  His  main  result  proves  the  existence  of  a  UMP 
Bayesian  test  when  the  conditional  density  f  (x | X )  has  a  monotone 
likelihood  ratio  in  x  and  the  hypothesis  and  the  alternative  are  both 
composite.  Examples  are  given  to  show  that  the  class  is  reasonably 


interesting. 


CHAPTER  II 


MEEDEN'S  RESULTS  AND  COMMENTS 

2.1  Notation  and  the  Statement  of  the  Problem 

2.1.1  Meeden's  work  is  part  of  his  doctoral  thesis.  To  summarize  his 

results  the  following  notation  is  used.  Let  (J and  (ft ,30  be  two 
measurable  spaces  with  X  and  ft  as  respective  ranges  for  the  random 
variables  X  and  A,  and  &  and  ^  a-algebras  of  measurable  sets 

of  as  and  ft  respectively.  Let  to  be  an  ^-measurable  subset  of  ft 
and  to  its  complement.  Let  f(x|A)  left  be  the  conditional  density 
of  the  random  variable  X  given  A  =  A  with  respect  to  some  a-finite 
measure  y  .  Sometimes  we  need  the  conditional  density  of  X  given 

to  then 

/  f(x|A)dG 

f(xlu)  “  ~  G (til) -  G<“>  >  ° 

Let  =  (G:G  is  a  c.d.f.  for  A  and  G  satisfies  p}  where  p 
is  some  property.  G  will  also  be  used  as  a  measure  on  ft  when  required. 

The  problem  considered  is  this:  (X,A)  is  a  random  vector  but 
only  X  is  observable  and  it  is  required  to  decide,  using  the 

Q 

observation  on  X,  whether  A  e  to  or  A  e  to  .  Let  6  (X)  denote  a 
decision  rule  used.  Then  6 (X)  is  required  to  be  optimum  as  described 
below  in  Section  2.1.2.  For  the  moment  6  : X  -►  [0,1]  such  that  when 

Q 

X  =  x  is  observed  it  is  decided  with  probability  6  (x)  that  A  e  to 


Thus  6 (X)  is  a  test  of 
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H  :  A  £  0)  against  A  :  A  e  u) 


c 


(1) 


Sometimes  we  need  to  refer  to  6 (X)  as  a  test  in  the  classical 


sense  and  sometimes  in  the  Bayesian  sense.  Meeden  uses  the  word 
"predictor"  when  6 (X)  is  considered  as  a  Bayesian  test.  But 
"predictor"  does  not  seem  appropriate  as  it  gives  the  incorrect 
impression  that  X  occurs  first  and  then  A  .  Finally  let  0  <_  a  <_  1 
and 


2.1.2  The  Statement  of  the  Problem 


problem  is  to  find  a  6  ,  if  any  exists,  such 


that 


(a) 


and  6  maximizes 


(2) 


o 


/  /  6  f  (x I A)dGdy 

4  4  c 

as  a) 


(b) 


In  order  to  avoid  repetition  whenever  (2)  has  a  solution 


that  context]  we  shall  denote  it  by 


6^  and  may  refer  to  it  as  the  UMP  Bayesian  test  relative  to 
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2 . 2  Some  Relations  Between  the  Classical  Tests  and  the  Bayesian  Tests 


Then 


(2) 


(A)  Let  G  be  a  known  distribution  for  A 
o 

has  a  solution,  by  the  Neyman-Pearson  lemma; 


and 
for  both 


=  (G  }. 
o 


/  f(x|X)dG  and  /  f(x|X)dG 

*  1  o  C  O 


are  non-negative,  y-integrable  functions  and  the  lemma  is  true  for  such 
functions.  Hence  there  is  no  real  claim  for  extension. 


6  <=> 

o 


(B) 


{ G :G  (Oi)  = 


6  UMP  classical  level 
o 


y ,  known , 
min  (^-,1) 


0<Y<l}  . 
test  of 


Then 
(1)  . 


(C) 

are  known}  , 


Let 

Then 


{G;G(o))=y 


unknown  but  f  (x  to) 


and 


f  (X  I  (jOC) 


6  <==> 

o 


Y  / 

se 


6  f(x  m)dy  <  a 
o  — 


VG  £ 


/I  C 

6f(x|u)  )dy 

X 

<==>  6  MP  classical  level  a  test  of  H  :  X  has  density 
o 

f(x|m)  against  A  ;x  has  density  f(x|u)C).  Meeden  only  asserts  sufficiency 
(<==»)  whereas  the  result  is  both  necessary  and  sufficient. 


4 


VG  e  ✓H-and  V6  e 


Di 


(D)  If 


^  -  {  G  s  < 


iS  <=>  6  UMP  classical 
o  o 

true  53 


is  any  possible  distribution  for  A}  then 
L — a  test  of  (1)  .  Note  this  is  also 


{G:G  is  a  degenerate  distribution  for  A}  . 
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2.3  Meeden's  Two  Main  Theorems  and  Comments 


Let  be  a  given  family  of  distributions  for  A 


Definition:  For  each  G 
exists,  such  that 


e  let  6_  (X)  be  a  solution,  if  one 

°  0  Go 


/  /  6  f  (x  I  X)  dG  dy  <  a 

»  “  Go  °  “ 


(a) 


and  maximizes 

G 

O 


(3) 


/  /  6f(x|A)dGdy  VG  z  and  6  e  Da 

c  1  0  G 

85  a)  w  c 


(b) 


«  «  I 

where  D  =  { 6 : J  J  fif (x  A)dG  dy<a}  .  Then  his  next  theorem  states: 
Go  &  °  - 


Theorem  2.3.1.  If  G  is  a  distribution  such  that  6  *  exists  and 

G 

6  *  e  DrL  then 


(i)  6  *  is  a  solution  of  (2)  relative  to 

G 


(ii)  If  exists  for  each  G  e  XL  then 


* 


* 


/  /  6  *f(x|\)dGdy  <  /  /  6  fdGdy  VG  e  JljL 

ss  "  0.°  G  t 


i.e.  G  is  a  least  favourable  distribution.  To  prove  (i)  we  note 

Qi  0 i 

that  2(a)  holds.  Next  6  e  Dp.  =>  6  e  D  *  hence  3(b)  and  therefore 

G 

ot  ot 

2(b)  holds.  To  prove  (ii)  we  note  that  6g*  e  Dg,  ==>  6g*  e  Dq 
VG  ej Hence  G  is  a  least  favourable  distribution.  □ 


He  then  goes  on  to  use  this  theorem  to  prove  theorem  2.3.2. 


28 


He  indicates  Theorem  2.3.1  may  be  useful  in  investigating  problems 
where  UMP  Bayesian  tests  do  not  exist  or  problems  are  being  considered 
that  are  not  testing  problems.  This  may  be  so  but  in  his  Chapter  III, 
he  has  not  used  this  theorem  anywhere  else,  and  as  will  be  observed 
there  is  no  need  to  use  Theorem  2.3.1  to  prove  Theorem  2.3.2. 


Theorem  2.3.2.  Let  X  and  A  be  real-valued  random  variables  and 


assume 


(i)  f(x  X)  has  a  monotone  likelihood  ratio  in  x,  i.e.  for 


X '  >  X  the  ratio 
of  x  . 


f  (x 

X') 

f  (x 

X) 

is  a  nondecreasing  function 


(ii)  H  :  to  =  (X<X  )  against  A  :  w  *  (X>X  )  .  Then  for  each 

—  o  o 


G  e 


* 


6q(x)  =1  if  x  >  cQ 

=  Y  _  if  x  =  c 
Cj 


■  0  if  x  <  c_  . 

o 


(4) 


And  if  3a  G  e 


6  *(x)  *  inf  6  (x)  Vx 


then  6q*  is  a  solution  of  (2)  relative  to  .  If 
VG  e  there  is  a  solution  to  (3),  then  G*  is  a  least 
favourable  distribution. 


Proof »  That  6_  is  given  by  (4)  follows  from  the  fact  that  for  the 

G 

MLR  family  and  H  against  A  as  in  (ii) ,  VX  <  Xq  the  UMP  classical 
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test  also  minimizes  error  of  type  I  subject  to 


I 

x 


6f  (x  A  ) dy 
o 


a . 


Next  6  *  (X)  =  inf  6  (X)  — >  6  *  (X) 
G  _  G  G 

GEvXA 

Without  loss  of  generality  assume 


Let 


6 


6(x)  =1 

if 

X 

-  Y 

if 

x 

=  0 

if 

X 

>  c 

a  c  0  <_  Y  <_  1 
<  c  , 


Then 


6  e  D?*  /  /  <Sf  (x|  A)dG*dy  <  a 

#  &  " 

mm>  I  !  [6-6  *]f(x|A)dG*dy  <  0 

e  «  G 

«•>  <$_*  >  6  a.e,  y 


>  /  /  _  [6  *-<SJ  f  (x|  A)dGdy  >  0 

K  »°  G 


VG  e 


2(b)  .  □ 


There  is  thus  no  need  to  appeal  to  Theorem  2,3.1, 


Having  proved  Theorem  2,3,2  he  has  given  four  examples  where 
such  tests  exist.  In  these  he  has  verified  the  existence  of  a 
G*  zJJL  such  that 


* 


6.,(X)  -  inf  fi_ (X) 

«** 


and  that  6  *  is  not  trivially  zero  or  one  everywhere.  Only  in  two 
G 
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examples  has  he  attempted  to  construct  the  corresponding  tests;  in  one 
on  the  basis  of  two  unproved  statements.  He  also  suggests  an  approximate 
construction,  which  can  be  used  when  these  statements  are  not  true. 

When  A  is  normal  he  has  not  mentioned  construction  at  all  and  it  does 
seem  that  exact  construction  is  possible  in  this  case;  this  will  be 
attempted  in  Chapter  III,  after  considering  a  result  proved  by  assuming 
that  there  is  a  G*  e  such  that  G*  is  a  least  favourable  distribu¬ 

tion.  According  to  this  result  the  construction  of  the  UMP  Bayesian 
tests  in  the  examples  considered  is  possible  whenever  we  know  a  G* 
which  is  least  favourable. 


. 


CHAPTER  III 


A  CHARACTERIZATION  OF  THE  LEAST  FAVOURABLE 

* 

DISTRIBUTION,  AND  THE  LOCATION  OF  6 


3 . 1  On  Using  the  Concept  of  a  Least  Favourable  Distribution 

=  {Gq:Gq  is  the  c.d.f.  of  A  ,  0£0}  be  a  parametric 
family  of  distributions.  Then  in  certain  families  and  for  certain 
hypothesis-testing  problems  it  seems,  intuitively,  that  guessing  the 
least  favourable  distribution  should  not  be  difficult.  In  such  families 
one  may  guess  the  least  favourable  distribution  from  the  fact  that 

such  a  distribution  renders  least  help  in  deciding  whether  A  e  w 

,  c 
or  A  e  a) 


For  example  let  {Gg:A  is  N(0,1)  /  -°°<0<oo}  and 

f(x|A)  =  N  ( A ,  1)  ;  further  let  H  :  A  e  a)  =  (A<A  )  against 

—  o 

Q 

A  :  A  e  a)  =  ( A> A  )  .  Then  for  usual  a  and  V0  such  that 

o 

| 0-A  |  >_  3  the  decision  making  is  made  very  easy:  either  always 

accept,  or  always  reject,  according  as  0  <  Aq  or  0  >  A^  .  However 

c  1 

when  0  =  A  G,  (u) )  =  GA  (co  )  =  —  and  the  distribution  is  the 
O  A  A  2 

o  o 

least  favourable.  For  any  other  value  of  0  ,  G  (oj )  ^  77  and  the 

0  2 

distribution  G~  is  of  more  help  to  the  statistician  than  G 

u  A 


JU 


Now  consider  the  special  case  Aq  =  0  with  and  f  (x | A ) 
as  specified  in  the  previous  paragraph.  For  this  case  Meeden  has 
proved  that  the  cut-off  point  c^  is  such  that 


(i)  lim  cQ 

A  U 

0-++OO 


—  00 
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(ii)  lim  c  =  -00 
0  -*■  -00 

(iii)  3  a6  3  cQ  >  -« 

(iv)  c  is  a  continuous  function  of  0  ,  where  c.  is  given  by 
0  0 

+  00  Q 

Iff  (x|  X)dG0dy  <_  a 

C  -°o 
0 

If  our  intuitive  guess  is  correct,  then,  by  Meeden's  theorem 


(x) 

0=o 


inf  <S  (x) 


inf  60(x) 
0eR  6 


Since  for  any  0 


<Sg  (x)  is 


6e(x)  =  1  x  >.  c0 

=  0  x  <  c« 


6a  (x )  =  inf  6  (x)  <=>  c  =  sup  c  . 

0=0  .  _  0  O  _  0 

0eR  0  £0 


c>  )  (c  )  =  1  => 

0=0  O 


inf  «. (c  )  -  1  — >  «. (o  )  »  1  V9  e  R 
9eR  0  °  80 


*>  c  >  c.  V0  e  R  =>  c  >  sup  c.  .  Clearly  c  <  sup  cn  .  Hence 

Q  ■—  0  H  o  — 


c  =  sup  ca  . 
°  9eR  8 


o  —  -  0 

0eR 


°  0eR  9 


<=  )  Suppose  x  >  c  then  6.  (x)  =1;  also  c  >  c»  V0 

—  o  0=o  o—0 

=»>  6a(x)  =1  V0  e  R.  If  x  <  c  then  Sa  (x)  =  0 

y  O  M  =° 


=>  $g-0(x)  Z.  Sq  (x) 


0=0 

6n  (x)  <  inf  6a  (x)  hence 
0=0  "  8eR  0 


Vx 


0=0 


(x)  <_  inf  60(x).  Clearly  6fliio(x)  L  ^nf  (x)  • 


0eR 


0=0 


0eR 


6  (x)  =  inf  <5  (x)  . 

6=0  9eR  9 


Hence 


' 
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Hence  if  our  guess  is  correct  V  a  0  <  a  < 
should  attain  its  sup  at  0=0.  Now  consider  a 
is  5 


1 ,  then  c 
=  y  ;  then 


c 

o 


+00  o 

/  /  f (x | A)dG  dy  <  —  . 

•>  *  '  o  —  2 

c  -°° 

o 


Here  equlity  is  possible  when  cq  =  -°°  .  For  then 


o  +°°  o 

/  /  f(x|A)dpdG  =  /  dG  =  —  . 

’’  v  1  o  J  2 

—00  —00  —00 


On  the  other  hand,  by  Meeden's  result,  V  a  0  <  a  <  1,  3a0  e  R 

$  c  >  -oo  hence  c  ^  sup  c.  and  as  guessed  G  is  not  the  least 
8  °  6cQ  6 

favourable  distribution.  Hence  it  is  not  true  that  G  is  the  least 

o 

favourable  distribution  for  all  a  .  It  appears  that  0  is  a  function 

of  a  .  Computations  in  the  form  of  plots  of  0  against  c^  ,  for 

ft 

a  =  .005  and  a  =  .05,  also  suggest  0  as  a  function  of  a  . 


i  2 

Next  if  we  consider  f(x|A)  =  N(A,x  ) 
then  it  seems  that  0*  is  a  function  of  (a,i,a) 
we  shall  derive  an  equation  in  c  *,  0*,  t  and 

U 

the  least  favourable  distribution. 


and  f  (A)  =  N (0  ,cj2) 

In  Section  3.3 

a  for  G  *  to  be 
0 


In  next  section  a  characterization  of  GQ*  is  obtained. 

Let  denote  a  parametric  family;  then  for  each  0  e  0,  by  the  Neymann- 

•» 

Pearson  lemma  there  exists  a  most  powerful  Bayesian  test  of 


H  i  A  e  w  -  (A<A  )  against  A  ;  A  e  co  ■  ( A> A  )  .  In  such  a  family 

—  o  o 

we  say  that  a  distribution  Gq*  e  XA  is  least  favourable  iff  the 


of  H  against  A  satisfies 


most  powerful  test  6 


- 
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I  f  6  f(x|A)dG  *d)j  <  /  6  f(x  A)dG0dy  V0  e  0 

c  G.  *  U  —  '  *  *  C  G.  0 

w  0  oo  0 


3.2  A  Characterization  of  the  Least  Favourable  Distribution 


Theorem  3.2.1.  Let 
(i) 

(ii)  f(x|A)  be  a  monotone  likelihood  ratio  family  in  x  ;  i.e.. 


=  { GQ : 0£0} 


for  A'  >  A, 


f  (X 

A') 

f  (X 

A) 

is  a  nondecreasing  function  of  x 


(iii)  H  :  A  £  u  =  (A<A  )  against  A  :  A  e  to  =  ( A> A  )  .  Then 

—  o  o 

G  *  is  the  least  favourable  distribution  iff 
0 


0 


_  ot 


6  *  (x)  e  Qqo  ,  where  6_*  =  6 


0 


V 


Proof:  Let  G  *  be  the  least  favourable  distribution.  As  seen  in 

0 


Chapter  II  V0  e  0 


6 (x)  =1  x  >  c 

0 

=  y6  x  =  ce  (oiYq!1) 

=  0  x  <  c  . 

0 

Since  G  *  is  the  least  favourable  distribution 

0 

/  /  [<S  *— 6  ]  f  (x I  A) dGQdu  <  0  V0  e  0  (1) 

0  — 

a)  86 

For  a  given  0  let 


S+  =  {x:60*-60>O} 


-  i  v 
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c  {x:x>cfl*,  x<cfl}  =  ^x:co*£x!ica  ^  =  s  say 


then  on  S  6*-6_=0.  Suppose  y  (S)  >  0  then 


/  /  [(5a*“(5cJ  fdydGQ  >  0  assuming  G(u>C)  >  0  ,  i.e.  a  contradiction 

C  jmo  0  U  u 

03  SS 

ct 

to  (1)  above.  Hence  6A*  <  6A  a.e.  y  V0  e  0.  Hence  <5rt*  e  Da.  . 


6*  -  0 


0 


.a 


Now  suppose  6q*  e  then  <$Q*  e  VG  e^  Since  60  is  the  MP 


0*  w  ^  w"~“  "0"  '  "G 


Bayesian  test  we  have 


/  c  /  [<S0*-(5e]  f  (x|  A)dydG0  £  0  (la) 

oo  $£ 


+  c 

using  S  and  S  as  above ,  we  have  6A*  -  6.  =  0  on  S  as  before; 

0  0 

and  if  y(S)  >  0  then  we  have 


J  c  I  [<$0*-60 ]  fdydG  >  0  assuming  G(ooC)  >0 

coc  se 

i.e.  a  contradiction  to  (la)  above.  Hence  6  *  <  6  a.e.  y  V0  £  0. 

y  —  y 

Hence  G^  is  the  least  favourable  distribution.  □ 

Corollary  3.2.1.  If  conditions  (i)-(iii)  of  the  above  theorem  are 

satisfied  and  if  for  some  0*  e  0  G„*  is  the  least  favourable 

0 

distribution  then 

(i)  6  * (X)  is  a  solution  of  (2),  as  in  Section  2.1.2. 

y 

(ii)  6  * (x)  =  inf  6  (x)  Vx 

6  0  £0  6 

ct 

Proof:  (i)  By  the  above  theorem  6.*(x)  e  Dj hence  (2a).  Also 

0  $ 

by  the  same  theorem  6n*(x)  <  6A  (x)  V0  £  0.  Hence  6  * (x)  is  a 

0  —  0  0 
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solution  of  (2)  * 


(ii)  6  *  (x)  <  6  (x)  V9  e  0  =>  6  *  (x)  <  inf  6  (x)  ,  and  clearly 

6  ~  d  9  _  0e0  6 

6  *(x)  >  inf  6  (x)  .  Hence  6  *  (x)  =  inf  6  (x) . 

0  "  0£0  6  8  0E@  ® 

Corollary  3.2.2.  If 

(i)  The  conditions  of  corollary  3.2.1  are  satisfied; 

(ii)  Q  is  a  subset  of  a  Euclidian  Space; 

(iii)  S  =  sup  c  is  attained  at  a  point  9*  e  0,  where  9'  is 
9e0  9 

a  limit  point  of  0  ,  then  9'  =  6*  or  cn*  =  sup  cQ  . 

0  -  „  b 


Proof:  Since  S  =  sup  cQ  is  attained  at  9',  S  =  c  .  Clearly 

0E0  9  0 

c Q  |  cft*  .  Let  x  <  cA,  ;  since  9'  is  a  limit  point  of  0  , 


9’ 


9 


9a  e  e  05  o  >  o  >  x;  but  o  >  x  =>  6  (x)  =  0  =>  Sai,U)  =  inf  6  (x) 
96  8  9  8  0£0  9 


inf  6  (x)  =  0  =>  x  <  e  * 
0e0  0  0 


Since  this  is  true  for  all  x  <  c 


i  • 


however  close  to  Cq,  ,  we  have  cA ,  <_  cfl*  .  Hence  cfll  =  cfl*  or 


9'  =  9*  .  □ 


A  particular  case  of  this  corollary,  when 
,=  { Gq  : A=N  (9,1)  , -°°< 9 <°° }  was  proved  in  Section  3.1.  In  this  case,  the 


fact  that  c  *  =  sup  c  ,  is  useful  in  finding  0  ,  and  hence  constructing 
9  0  £0  8 

6  *  (x) ,  which  Meeden  has  not  done.  Similarly,  it  seems,  that 
0 

Corollary  3.2.2  will  be  useful  in  constructing  UMP  Bayesian  tests  in 


other  examples  considered  by  him. 


In  the  following  section  we  give  a  heuristic  proof  of  the 

piecewise  monotonicity  of  c  in  the  normal  case,  then  derive  an 

b 

equation  in  9*  and  other  variables. 


- 
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3.3  Piecewise  Monotonicity  of  c 

b 

Let  {G0  :A=N  (6  ,T2)  ,  -°c<0<+°°  ,  t2>0} 

f  (x |  X)  =  N(X,o2) 

H  :  X  <_  0  against  A:  X  >  0  . 

For  the  construction  of  the  UMP  Bayesian  test  we  look  for 

■jfc 

the  least  favourable  distribution,  i.e.  for  0  such  that  G  *  is  the 

b 

least  favourable  distribution.  For  a0  e  R  c  is  defined  as  follows 

b 


Vx) 


1  if  x  >  c 
—  b 

0  x  <  c0 


such  that 

+<»  o 

/  J  f(x,X)dXdx  <_  a ,  0  <  a  <  1  (2) 

r*  —oo 

8 

o 

Clearly  c.  =  -°°  if  j  f. (X)dX  <  a  and  we  require  that 
b  *  b  — 

—00 

+°°  o  O 

J  /  f(x,X)dXdx  should  be  as  large  as  possible.  If  /  f^(X)dX  >  a 

C  —00  —  oo 

0 

then 

+oo  o 

J  J  f(x,X)dXdx  =  a  with  c^  >  -00  (3) 

r*  —00 

C0 

Now  for  a  given 

„  ,  ,  .  1  r  1  r  ,x-X.  2 .  ,X-0V  2,  . 

Vx'X)  “2^exp[-  2  {(~>  +(_r)  }1 

(x-A)2  =  [ (x-0 )- (A-8) ] 2  we  have 


writing 
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Vx'X)  =I^exP[-i{i2S;:£f--4  (x~e)  u-0)  +  t-^-  +  -\)  (A-ej 2>] 

0  0  O  T 


1  .  1  (t 2+a2)  /  (x-0)2  2t 

2ttto  exp[  2  2  ,  2  ,  2,  ,  -a-,  „  ‘  — t-  t 


(t  +a  ) 


(x-6)  .  (X-6)  +  (A-6)j 


i.e.  for  a  given  0  (x,A)  is  a  bivariate  normal  vector  with  common 

2  2  2 

mean  0 ,  var  X  =  (t  +o  )  ,  var  A  =  t  and  correlation  coefficient 
t//tz+gz 

Hence,  for  0  <<  0  most  of  the  probability  mass  is  distributed 
over  the  third  quadrant;  as  0  increases  the  common  mean,  0  ,  shifts 
along  the  line  x  =  A ,  and  the  probability  mass  over  the  first  quadrant 
increases . 

00  o 

On  the  other  hand  the  mass,  /  J  f(x,A)dAdx,  over  the 

k 

shaded  region  of  Figure  I  increases  as  0  increases  to  a  value  0 
and  then  it  decreases.  For  large  and  negative  0  , 


2  2 

/  f  (x,A)dA  f  (x)  =  N(0,  (x  +0  )  ) 

— OO 


FIGURE  I 
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and  hence  as  0  increases  c.  must  increase  for 

0 

+°°  o 

/  f(x,A)dAdx  =  a  to  hold  (0<<O)  .  Moreover,  if  0.  >  0,  ,  and  if 

'  2  1 
n  —oo 

C0 


+oo  o  +°°  o 

/  /  f  (x,A)dAdx  =  a  and  f  j  f  (x,A)dAdx  >  a 


'0 


-00 


c  -oo  ^2 
\ 


+°°  o 

then  for  /  /  ffl  (x,A)dAdx  =  a  to  hold  c^  must  be  greater  than 


'0 


-  6  2 


cn  .  And  it  seems  that  c.  increases  as  0  increases  to  a  value 
0i  8 

0*  and  then  c  decreases  as  0  increases. 

0 


Hence  we  take  c  to  be  piecewise  monotone  and  therefore 

0 

+00  o 

differentiable  almost  everywhere  on  0  =  {0:/  /  f (x , A ) dAdx=a , 

—oo 

0 

ca>-“) •  0  c  is  sufficiently  smooth  and  we  assume  it 

0  0 

differentiable  everywhere  on  0  .  From  Sections  3.1  and  3.2  we 


know  that  cn*  =  sup  c.  since  c  is  differentiable  on  0  we  obtain 

6  e£0  6  6 


dc 


0*  by  differentiating  and  solving 


d0 


6  =  0  for  0* 


It  should  be  remarked  that  plots  of  c_  against  0  also 

0 


indicate  the  piecewise  monotonicity  of  c 


0 


For  all  a  ,  0  <  a  <  1,  since  cQ*  =  sup  cD  , 

8  0£0  8 


+00  o 

0*  e  0  =  {0:/  /  f  (x,A)dAdx=a,  cQ>-°°} 

r  —oo 
c0 


Also 


+°°  o 


/  /  f(x,A)dAdx  =  a  ¥0  e  0  as  defined  above 


—oo 

C0 


(4) 
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and  we  have,  in  the  following  lemma,  an  equation  to  locate  0 


w 

Lemma  3.3.1  0  is  the  solution  of  the  equation 


.  i  e2  ,  ce, 

exp[-  -  — ] l»{-  — } 
T 


2  2  2  2 

!  ,62  C0,.  1  (0G  +C0T  } 

exp [-  —  (—  +  —)+  —  — - — - — j-y] 

x  a  (x  +a  )x  a 


2  2 
(0a  +c0i  ) 

Ta/i2+a2 


■} 


obtained  by  differentiating  equation  (4)  with  respect  to  0  in  the 
following  form: 


+°°  o 


2ttq 


- —  /  /  exp  [- 

OT  J  J  V 


r»  —oo 
°0 


i{^+^}]dXdx 


=  a  V0  e  0 


Proof:  Differentiating  the  above  equation  with  respect  to  0  we  have 


■c^  /  exp  [- 

—00 


1  iv^_+  (X^eii 

2  2  2 


(X-6) 


+°°  o 

/  / 

C  — 00  T 

c0 


r  1  r (x-X)2  (X-0)2n ,  „  , 

exp  [-  -  {- — ~~  +  - y — }  ]  dA dx 

a  x 


=  0 


or  c'  =  0  iff 
0 


O 


-/  / 


(X-8) 


C  — 00  T 
C0 


r  1  r  (X-X)2  .  (X-0)2^  „  , 

exp  [-  j  { - - —  +  - 2 — ^dAdx 


=  0 


(X-0) 


(x-X )  _  (X-0)  (x-X) 

2  2  2 
a  t  a 


writing 


/ 


cl  -  0  iff 

U 
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+0°  i  2  n2 

/  exp  [-  —  +  — }]dx 

C0  a  T 


+0°  o 


-  I  I 


(x-A ) 


c*  —oo 

0 


a 


r  1  r  (x-A)2  .  (A-0)2, ,  „  , 

exp[-  ‘J  1 - 2 -  +  - 2 - 


=  0 


.2.2  +°° 


i.e.  iff 


-H’Q  A  r  r  lx 

J  exp [-  —  — ]dx 


2  2' 
a 


+°°  o 


-/  / 


(x-A) 


C0  a 


,  1  r  (X-A)2  ( A  — 0  )  2-|  ,  ,,  , 

exp[-  —  { - - -  +  - - — }]dAdx 


i.e. 


, _  I  fl2  Cn 

/2tT  a  exp  [-  —  — ]  ${ - } 

0 

X 


o  +oo  2  2 

r  r  r  1  (A-0)  ,  (x-A)  r  1  (x-A)  „ 

=  J  J  exp  [-  -  - - - ]  - —  exp  [-  -  - - — ]  dxdA 

-°°  c  t  a  a 


=  /  e»P[-  2  2 


i  <x-er,  r  i  (c0  X)  ,  „ 

]  exp  [-  — - - — ]  dA 


=  exp[-  i  +  -f}]/  exp[-  i  {  +  4r)X2-2(4r  +  — |-)  X }  ] 


2  '  2 
x 


2  w  '  2  2' 
t  a 


2  2 
x  a 


2  2  2 
.  A2  ca  o  ..22.  _  (0a  +cAx  ) 

r  1/0  t  r  r  1  (x  +a  )  ry2  A  0  ,  i,  ^ 

=  exp  [-  —  (—  +  — )  ]  J  exp  [-  -  — — —  {A  -2  - - — - A}]  dA 

x  a  — 00  x  a 


,  2  2, 

(x  +0  ) 


_  2  A  A  A  2  2  2  2  2 
■\  q2  ca  o  .  2  2.  0a  +cAx  (0a  +cAx  ) 

=  exp  [-  —  (—  +  — )  ]  /  exp  [-  —  — A— A—  ■  {A - - - — }  ]  exp  [—  — dA 


2  '  2  2‘ 

x  a  -°° 


2  2  2 
x  a 


,  2  2S 
(t  +a  ) 


2  2  2  2  2' 
(x  +a  )x  a 


2  /A  2  2  2 
,  A  cA  .  (0a  +cAx  ) 

r  1  .  0  0.1  0  ,  xa  /• 

exp  [  -  —  (—  +  — )  +  —  — - — - — 7-^7]  - J 


2  '  2  2  2,2  2V  2  2 
x  a 


.  Z  Z  Z  Z  /  o  o 

(x  +a  )x  a  vxz+az 


-(0a  +c  x  ) /xa/x2+a2 

9  12 

exp  [-  —  A  ] dA 
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where  A  = 


/T2 


X^+0‘ 

TO 


[X- 


n  2  2 

0a  +cQx 

U 

,  2  2~ 

(x  +a  ) 


=  /2tT 


2  2  2  2 

to  f  1  ,62  ,  c6  1  (6°  +V  >  .  .r 

-  exp  [-  —  (—  +  — )  +  —  — - - - — x  ${. 

r~n~, — T  2  2  2  2  ,  2,  2,  2  2 

vx2+az  t  a  (x  +a  )x  a 


(0a2+cQT2) 


-} 


xa 


42+a2 


Hence  the  result: 


i  e2  ,  ce, 

exp[-  j  — 1*<-  — > 

T 


0  2  2  2  2 

T  r  1  ,02  C0  1  (9a  +C0T  }  , 

-  exp [-  —  (—  +  — )  +  —  — - — - — — -] 

r~ o~ — n~  2  2  2  2.2  2.  22 

/Tz+a2  x  a  (x  +a  )T  a 

2  2 
0a  +c  t 

- — }.  □ 

xa/x2+a2 


2  2  * 

Corollary:  If  a  =  x  =1  then  0  is  the  solution  of 


12  1  1  2 
exp [-  —  0  ]${-cQ}  =  —  exp [-  —  (cQ-0)  ]  $>{ - } 


/2 


4  '  0 


/2 


Hence  we  confirm  the  statements  made  in  Section  3.1  that  where 

2  2 

f(x|X)  =  N(A,a  )  and  f(A)  =  N(0,x  )  0*  is  a  function  of  (a,x,c); 

2  ^ 

and  in  particular  if  a  =  x  =1  then  0  is  a  function  of  a  . 

Following  are  tables  for  0  against  c  for  a  =  .005  and 

u 

a  =  .  05 


r  + 
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TABLE  II 


(i)  a  =  .005 


Table  of  Values  of 


c 


0 


0 

-2.5 

-2.0 

-1.5 

-1.0 

-0.5 

0 

0.5 

1.0 

1.5 

2.0 

2.5 

C8 

1.01 

1.28 

1.61 

1.76 

1.86 

1,84 

1.73 

1.48 

1.12 

.47 

-1.23 

From  the  graph  0*  =-.4  ca*  =1.9 

•  0 


/2  exp [-  j  (.4) 2]${-1.9}  =  1,414214  x  .923116  x  .0287 

=  .03785 

exp  [-  \  (2.3)  2]  ${ -  =  .03862 

4  /2 


Difference  .03862  -  .03785  =  .0008  . 


TABLE  III 


(ii)  a  =  .05 


Table  of  Values  of  c 


0 

-.8 

-.7 

-.6 

-.5 

-.4 

-.3 

-.2 

-.1 

0 

.1 

.2 

.3 

.4 

ce 

.713 

.728 

.74 

.76 

.75 

.75 

.73 

.72 

.69 

.67 

.64 

.58 

.54 

From  the  graph  @*=-,5,  =  .76, 

/I  exp  [-  j  (,25)]*{-.76>  «  1.414214  x  .882497  x  .2236 


279062 


Case  (i)  a  =  .005 
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u-> 

CN 


o 

oi 


U-> 


«o 

o 


-  o 


u-> 

o 


•o 

i 


o 

oi 

i 


oi 


O 

oi 


u-> 


u-> 

O 


CD 


Q> 

U 


FIGURE  II 


Case  (ii)  a  =  .05 
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Q> 

U 


FIGURE  III 
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exp[-  -j  (1.26)2]${-  =  exp  [.  3969]  ${-.  1838} 

4  /2 

=  .672401  x  .4274 


=  .28738 


Difference  =  .00832  . 


3 . 4  The  Construction  of  the  UMP  Bayesian  Tests 

Example  1.  ^  is  N(0,1),  -oo<0<+oo} 

f (x| X)  =  N  (0 ,1) 


H  :  (X<X  )  against  A  :  ( A > A  ) 
—  o  o 


Let  0  <  a  <  1.  For  a  given  0  to  determine  c  [or 

b 

6  (x) ]  we  have ; 
b 


f(x,X)  =  ~  exp[-  J  { (x-X) 2+ ( A-0 ) 2}] 


-00  <  X  <  00 

—00  <  X  <  00 


exp  [- 


27rxv/2xlx/l-02  2(l-p  ) 


{ 


(x-0) 2  „  (x-0)  (X-6)  .  U-8)2,, 

- — - 2p - r +  - - - )] 

2  /2  1  1 


(X,A)  has  bivariate  normal  density  with  y  =  y  =  0, 

X  A 

2  2  1 

a  =  2,  a  =  1  and  p  =  —  .  For  a  given  0  as  indicated  in  the 
X  A  sfi 


60 (x)  «  i  *  I  ce 


0  X  <  C, 


proof  of  Theorem  2.3.2 


*  >  / 


»'<,  '  ;  n 


0  i  * 
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where  is  determined  by 


+°°  X 

/  /  °  f(x,X)dxdA  =  a 

ce  -00 


f(x,X)  as  in  (5)  above.  To  use  the  bivariate  normal  tables  let 


x-6 

/2 


and 


A-9 

1 


-X 


1 


then 


-J-oo  -)-oo 

/  /  f  (x  ,A  )dx  dA  =  a 

<c  -e>//2  e-x 

9  o 


where  f(x  ,A  )  =  - - -  exp  [-{xf+A^+2x—  x.X.  }] 

1  1  27TX1X1/I3J  11  /2  1  1 


(6) 


i.e.  bivariate  normal  with  u 


UA  =  °'  °X  =  °A 
A1  X1  A1 


=  1  and 


P  =  ~ 


/2 


Letting  =  0,  a  =  .05  the  least  favourable  distribution 
corresponds  to  9  y».-.5  hence  6g*(x)  is  the  UMP  Bayesian  test  and 

V<x>  =  1  if  x  i  v 

■  0  <  V 


+co  4-00 

where  /  /  f (x  ,A  )dx  dX  = 

(V+.5)//2  -.5  1  1  1  1 


.05  . 


A  «+ 


\ 


JaJ  ealcted  Ifi/raon  s^Biu&vid  9rfd  9au  oT  .9vod£  (2)  ni  as  (A,x)5 


A- 


— —  bnfi  rx  =  - 

IV 


CO+ 


(d) 


r  r  r  I 


:•:) 


/  M  =  ,, M  dd  w  lemion  «*tsix'iv.:d  -  .1 


noidudisdaib  elde^ovsl^daeal  arid*''  50.  =  a  x0  -  A  pnidj 9j 


<3MU  srtfsi  (x).0a  sonart  2.-  *8  oJ  abrroqeaxToo 


> 


50. 


^  \<e.+*l3o) 
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In  order  to  use  the  standard  bivariate  integral  tables  the 
following  relations  are  used. 


4.00  +00 

L[h,k,p]  =  /  /  f  (x , A  ,p ) dxdX  h,k  >_  0 

h  k 


(7) 


where  f(x,A,p)  * - — .  exp[ - {x2-2pxA+A2}] 


2tt/1-pz  2(l-p  ) 


L [h ,k ,p ]  =  L[k,h,p] 


(8) 


L[-h,k,p]  =  -L[h,k,-p)  +y[l-a(k)] 


(9) 


L  [*-h  ,--k  ,p  3  =  L[h,k,pl  +  ~  [a  (h) +a (k) ] 


(10) 


+h 


x  X  2 

where  at  (h)  ■  /  exp[-  —  x  ]dx  . 

ss  -h  2 


These  are  quoted  from  Tables  of  the  Bivariate  Normal 
Distribution  Function  and  Related  Functions. 


Also  (i)  The  approximation  -  w  .  7  rather  than  .71 

/2  ~ 

is  used. 

(ii)  wherever  necessary  linear  interpolation  is  used. 


To  compute  the  power  of  a  test 


6e  (x)  =  1  «>  ce 


<  c, 


' 


' 
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for  a  =  .05  and  for  a  given  value  of  0  we  have,  using  the 

X~  0 

transformation  -  =  x.  and  X  -  0  =  A. , 

/i  1  1 


4-00  4.00 

*1  1  A 

Power  =  - -  /  I  expt - —  {x  -2px  X  +X,}dx,dX, 

2ii (c0-9)//2  -8  2  (i-o2)  1  1  1  1  1  1 


P  f  .7 


& 

Powers  are  computed  for  0  =  6,  0=0  and  for  the 

classical  UMP  test.  The  results  are  given  in  Table  XV, 


TABLE  IV 

Power  of  ^  q *  (x)  ,  a  *  ,05 


6 

-2,5 

-2.0 

-1.5 

-1.0 

-0.5 

0 

0,5 

1.0 

1.5 

2.0 

2.5 

.  76-0 

A 

2.31 

1,95 

1,60 

1,25 

.89 

.54 

.18 

-.17 

-.52 

- .  88 

-1.23 

p(0) 

.0019 

.0079 

.0248 

.0638 

.1380 

.2452 

.3373 

.5497 

.6994 

.  8069 

.8897 

Power  of  6  (x) ,  a  ■  ,05 
o 


0 

-2.5 

-2.0 

-1.5 

-1.0 

-0.5 

0 

0.5 

1.0 

1.5 

2.0 

2.5 

.69-0 

/2 

2.26 

1.90 

1.55 

1.20 

.84 

.49 

.13 

-.22 

-.57 

-.93 

-1.28 

p  (6 ) 

.0023 

.0085 

.0265 

.0677 

.1503 

.2600 

.4148 

.5651 

.7000 

.8100 

.8990 
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TABLE  IV  (Continued) 

Power  of  6^(x)  [Classical  UMP] ,  a  =  .05 


0 

-2.5 

-2.0 

-1.5 

-1.0 

-0.5 

0 

0.5 

1.0 

1.5 

2.0 

2.5 

1.65-0 

/2 

2.93 

2.58 

2.23 

1.87 

1.52 

1.17 

.81 

.46 

.11 

-.25 

- .  6 

P  (0 ) 

.0007 

.0025 

.0085 

.0230 

.0560 

.1220 

.2030 

.3290 

.4550 

.5980 

.725 

The  power  curves  are  plotted  in  Figure  IV,  we  note  that 

6  * (x)  and  <5  (x)  have  almost  the  same  power  curves  and  perhaps,  for 
d  o 

a  =  .05,  the  guess  that  6q(x)  is  t^ie  UMP  Bayesian  test  is  not  far 
off. 


Example  2 . 


=  {fA(6)=(^)eA(l-0)n  X  A=0 ,1,2 , . . . ,n,  0e [0 , 1] } 


f(x  A)  = 


A)  (n  X 
x  m-x 

o 


for  x  =  0,l,2,...,m  <  n 


=  0  otherwise 


Here 
<$ q*  (x) 


H  :  A  <  X  against  A  :  A  >  A 
—  o  o 

We  consider  the  case  n  =  7,  m  =  6,  A 

c 

0  is  unknown  yet  but  intuitively  6  (x) 

e=e1 

where  0,  is  such  that  G„  (oo)  =  —  . 

1 

To  construct  <5  (x)  we  solve 

U  - 


=  5  and  a  =  .05. 
seems  close  to 


5 

-  I 

A=o 


(x7)0X(l-0)7-A 


1 

2 


h(0) 


Power  Curves,  f (x  X)  normal,  a  =  .05 
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u-> 

cm 


CM 

i 


V) 

I 

O 

i 

V) 

o 

i 


in 

o 

i 


in 

i 


CM 

l 


m 

CM 


Q_ 


CD 


FIGURE  IV 


52 


This  has  the  solution  0^^0.77151.  That  h  ( 0 )  =  -j  has  a 
unique  solution  follows  from  the  fact  that  h(0)  is  a  continuous, 
decreasing  function  of  0  ,  with  h(0)  =  1,  h(l)  =0.  It  is  a 
decreasing  function  of  0  as 

1-0  n-A  -1 

h  (6 )  -  (n-X  )  <f  )  /  t  °  (1-t)  °dt  . 

O  A 

O  O 

The  joint  density  f(x,A)  is: 


f  (x,A)  =  (6)  (  1  )  0A  (1-0)  7  A 

X  A  — X 


x  =  0,1 
A  =  0,1 


/  6 

,6,7 


(11) 


when  0=0^  the  joint  density  is  as  in  Table  V. 


TABLE  V 

The  Joint  Density  f(x,A)  When  0  =  .77151 
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TABLE  VI 

Power  of  6  (x) ,  a  =  .05 


6 

0 

.2 

.3 

.4 

.5 

.6 

.77151 

.8 

.9 

P(B) 

0 

.0003 

.0025 

.0127 

.0430 

.1111 

.3797 

.4458 

.7176 

Power  of  6^(x),  a  =  .05 


e 

0 

.2 

.3 

.4 

.5 

.  6 

.77151 

.8 

.9 

Pie) 

.0000 

.0001 

.0013 

.0067 

.0238 

.0663 

.2615 

.3151 

.5872 

Hence  6  (x)  =  1  x>5 

9i 

.05 

55  111  1  1  11  - .  X  33  5 

,08562 

■  0  x  <  5 

This  follows  from 

6  5 

ll  «A  (x) f (x,X)  -  .05 
x=o  A=o  o 

f(x,A)  as  in  Table  V.  Power  of  6.  (x)  for  any  value  of  0  is  given 


6  7 

l  l  6Q(x)f(x,A)  . 
X“o  A»6 


by 
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For  0 


this  becomes 


.05 


.08562 


{f (x=5,A=6)+f (x=5,A=7) }  +  { f (x=6 ,A=6) +f (x=6,A=7) }  =  .3797 


For  some  other  values  of  0  ,  the  power  is  given  in  Table  VI. 

Comparison  with  the  classical  UMP  test,  assuming 
\  =  constant  =  5  we  have 


f  (x  5) 


(*>  <6-X> 

(6> 


x  “  0,1,2, , , , ,5 


i.e.  f(x=4/5)  =  5/7  and  f(x*5|A=*5)  *  2/7  .  Hence 


6  (x) 
u 


.05 

2/7 


.175 


m  0 


x  >  5 

x  *  5 
otherwise. 


Power  is  tabulated  in  Table  VI  and  curves  are  as  shown  in 
Figure  V. 

Conclusion:  In  conclusion,  it  has  not  been  possible  in  this  thesis  to 
locate  0*  in  other  examples  considered  by  Meeden.  Even  in  the  normal 
case  the  construction  of  60*(x)  is  carried  out  when  8*  is  a  function 
of  a  only.  It  might  be  of  interest  to  study  the  relation  between 
0*  and  t  ,  where  A  is  N(0,t2)  and  f(x|X)  *  N(X,1),  when  a  is 
kept  constant;  perhaps  lim  0*  exists. 

T-+0 
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FIGURE 
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Finally  in  case  of  the  monotone  likelihood  ratio  family  and 

H  :  A  <  X  against  A  >  A  ,  classical  UMP  tests  exist;  Meeden 
—  o  o 

proved  the  existence  of  UMP  Bayesian  tests  for  the  same  case. 

Perhaps  UMP  Bayesian  tests  also  exist,  say  for  the  same  family 
and  HiA^A^  or  A  >_  A 2  against  A^  <  A  <  A^  .  Because  of  lack 
of  time  it  has  not  been  possible  to  investigate  the  problems  mentioned 
above . 
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